Uncorrelated feature encoding for faster image style transfer
نویسندگان
چکیده
Recent image style transfer methods use a pre-trained convolutional neural network as their feature encoder. However, the is not optimal for but rather classification. Furthermore, they require time-consuming alignment to consider existing correlation among channels of encoded map. In this paper, we propose an end-to-end learning method that optimizes both encoder and decoder networks task relieves computational complexity correlation-aware alignment. First, performed updates only also parameters in training phase. Second, addition previous content losses, uncorrelation loss, i.e., total coefficient responses channels. Our loss allows generate map without correlation. Subsequently, our results faster forward processing with light-weighted transformer correlation-unaware Moreover, drastically reduced channel redundancy during process. This provides us possibility perform elimination negligible degradation generated quality. applicable multiple scaled by using cascade scheme user control strength through usage content-style trade-off parameter.
منابع مشابه
Real-time Image Style Transfer
Artistic style transfer has long been an interesting topic in computer vision research. Recently several methods for style transfer based on convolutional neural networks have been proposed. This project aims at understanding and implementing some of the existing methods. More specifically we succeed in implementing the optimization based neural algorithm as well as the real-time style transfer...
متن کاملNeural Stereoscopic Image Style Transfer
Neural style transfer is an emerging technique which is able to endow daily-life images with attractive artistic styles. Previous work has succeeded in applying convolutional neural network (CNN) to style transfer for monocular images or videos. However, style transfer for stereoscopic images is still a missing piece. Different from processing a monocular image, the two views of a stylized ster...
متن کاملUniversal Style Transfer via Feature Transforms
Universal style transfer aims to transfer any arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or compromised visual quality. In this paper, we present a simple yet effective method that tackles these limitations without training on any pre-defined styles. The...
متن کاملFace Sketch Synthesis with Style Transfer using Pyramid Column Feature
In this paper, we propose a novel framework based on deep neural networks for face sketch synthesis from a photo. Imitating the process of how artists draw sketches, our framework synthesizes face sketches in a cascaded manner. A content image is first generated that outlines the shape of the face and the key facial features. Textures and shadings are then added to enrich the details of the ske...
متن کاملVisibility of uncorrelated image noise
In this study, we evaluated the effect that pixel size has upon people’s preferences for images. We used multispectral images of faces as the scene data and simulated the response from sensors with different pixel size while the other sensor parameters were kept constant. Subjects were asked to choose between pairs of images; we found that preference judgments were primarily influenced by the v...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Networks
سال: 2021
ISSN: ['1879-2782', '0893-6080']
DOI: https://doi.org/10.1016/j.neunet.2021.03.007